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IMAGER SYSTEM AND METHOD WITH FILTERING 

BACKGROUND 

[0001] Description of the Related Art 

[0002] A variety of consumer and scientific devices use 
digital imaging and post -processing to capture and record 
still and moving images. Flatbed scanners, copy machines, 
digital cameras, and the Hubbell space telescope all use 
an imager having pixels sensitive to electromagnetic ra- 
diation (ER) to capture an image of an object. Both CCD 
(charge-coupled device) and CMOS (complementary-metal ox- 
ide semiconductor) imagers have pixels arranged in either 
a one or two-dimensional array, combined with light - 
guiding optics. The spatial resolution of an array of 
pixels in an imager refers to the array's ability to re- 
solve dimensions on a document to be imaged. The resolu- 
tion can be defined as the number of resolvable image 
units (RIUs) discernable on the imaged object. The spa- 
tial resolution of the imager may be limited by the qual- 
ity of the mirrors and lens but is fixed because of their 
fixed relative positions in the illustrated system. 
[0003] Spatial resolution is of particular concern to 
imager designers, as is cost and light sensitivity, all 
of which are affected by pixel size. The resolution of 
imagers, such as scanners, is fixed, in part, by the size 
of the pixels. If pixel dimensions are halved to allow 
twice as many pixels in the imager, the spatial resolu- 
tion of the system could be increased proportionally. Ad- 
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varices in semiconductor processing have allowed manufac- 
turers to reduce pixel sizes to allow more pixels per 
unit area in an imager. Unfortunately, while reducing 
pixel size allows improved spatial resolution, the im- 
5 provement is at the expense of reduced signal -to-noise 
ratios (SNR) . The reduction also reduces light sensitiv- 
ity and increases susceptibility to pixel blooming caused 
by improper shuttering. 

[0004] Effective shuttering mitigates some of the suscep- 

10 tibility to blooming caused by reduced pixel size. Such 
shuttering may be accomplished either electronically, by 
varying the frequency of pixel readout and reset (in the 
case of a CMOS imager) , or mechanically, by controlling 
the amount of light that reaches the imager. Unfortu- 

15 nately, while use of the shutter helps to resolve bloom- 
ing issues, it does not help to reduce other problems re- 
sulting from smaller pixel size, such as a reduced SNR. 
[0005] One approach to obtaining better spatial resolu- 
tion without sacrificing an imager's SNR is to increase 

20 pixel size. This approach, however, increases system size 
and cost. Another approach is to map multiple points on 
an object to the same pixel and perform multiple scans to 
capture the points for later recombination by a processor 
into a complete image . Separate scans are performed and 

25 the images recombined to form the complete image. Unfor- 
tunately, such solutions tend to increase manufacturing 
cost and system complexity. 

[0006] A need continues to exist to improve spatial reso- 
lution without increasing system cost, pixel count or re- 
3 0 ducing pixel size. 



SUMMARY 

[00 07] An imager system and method has, in one embodi- 
ment, a pixel and a first filter positioned in an inci- 
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dent light path for a portion of the pixel, the filter 
being operable to alternate between transmitting and 
reducing incident light on the pixel portion. 
[0008] In one embodiment, a method is described as di- 
5 recting light from different locations of an object to 
different portions of the pixel, alternately transmitting 
and at least partially blocking the light for the differ- 
ent pixel portions in sequence, and reading out the pixel 
at different times corresponding to the transmission of 
10 the light to the different pixel locations. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] The components in the figures are not necessarily 
to scale, emphasis instead being placed upon illustrating 
15 the principals of the invention. Moreover, in the figures 
like reference numerals designate corresponding parts 
throughout the different views. 

[0010] Figure 1 is a block diagram illustrating an em- 
bodiment that has a filter array positioned immediately 
2 0 above an array of pixels, with both arrays controlled by 
a processor. 

[0011] Figure 2 is a block diagram illustrating an em- 
bodiment with first and second filters over the light- 
sensitive portion of a pixel in a CMOS imager. 

25 [0012] Figures 3A-3D are perspective views of an embodi- 
ment with first through fourth filters positioned above 
each individual pixel in an array of pixels, with each of 
Figures 3A-3D representing different filtering and trans- 
parent states of the filters. 

30 [0013] Figure 4 is a perspective view of an embodiment 
with odd and even multiple-pixel filters, with odd- 
numbered filters in their filtering states and even- 
numbered filters in their transparent states. 
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[0014] Figure 5 is an exploded perspective view and ray 
schematic of an optical shutter, using a ferroelectric 
liquid crystal (FLC) cell, for use in the embodiments il- 
lustrated in Figures 3A through 4 . 
5 [0015] Figure 6 is a cross section of an embodiment with 
a filter and pixel array seated in a packaging structure. 

[0016] Figure 7 is a block diagram and ray schematic of a 
document scanner that has a filter array positioned in 
front of the imager to enhance spatial resolution. 

10 

DETAILED DESCRIPTION 

[0017] An imager, in accordance with an embodiment of the 
invention, has an array of ER-sensitive pixels with a 
plurality of radiation reducing mechanisms ("filters") 

15 associated with portions of each pixel. Although the em- 
bodiments are described in terms of ER in the visible 
spectrum, the wavelength of ER used would depend on the 
sensitivity of the imager to that wavelength and the 
ability of the filters to reduce the ER on the pixels. 

2 0 Consequently, the term "light " means any ER that the ar- 
ray of pixels is sensitive to. The filters are positioned 
between the pixels and the object to be imaged. Prefera- 
bly, the filters are positioned either immediately adja- 
cent the pixels or immediately adjacent the object to be 

2 5 imaged. Because the area of each pixel corresponds to a 

specific area on the imaged object, the ability of a 
processor to distinguish between points on the imaged ob- 
ject is increased by sequentially actuating the filters 
over each pixel in a plurality of scans which are com- 

3 0 bined into a single image. In effect, the sequential ac- 

tivation and plurality of scans increases the number of 
pixels in the array without translating the pixels rela- 
tive to the imaged object between scans. Embodiments of 
the invention can be expanded to greater spatial resolu- 
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tions by increasing the number of filters associated with 
each pixel, and is limited only in the ability to fabri- 
cate progressively smaller filters and to distinguish be- 
tween progressively smaller levels of illumination on 
5 each pixel . 

[0018] Figure 1 illustrates first and second filters 
(100, 105) in a filter array 110 positioned above indi- 
vidual pixels 115 in a pixel array 12 0 with both arrays 
(110, 120) in communication with a processor 125. The 

10 processor 125 is coupled to a timing and control section 
13 0 which provides coordinated-control signals to both 
the pixel array 12 0 for pixel readout and to vertical and 
horizontal filter drivers (135, 140) for filter array 110 
actuation. The vertical filter driver has first and sec- 

15 ond vertical outputs (136, 138) coupled to each of the 
first and second filters (100, 105) , respectively. The 
horizontal driver has first through fifth horizontal out- 
puts (141, 142, 143, 144, 145) each coupled to a separate 
first and second filter (100, 105) . A particular filter 

20 is actuated when it receives both a vertical and horizon- 
tal actuation signal, either positive or negative volt- 
age, from the two drivers (135, 140) . Each of the pixels 
115 provides readout data when they receive a readout 
control signal from the timing & control section 13 0. 

25 [0019] The readout data is communicated to an analog-to- 
digital (A/D) converter 147 which converts the analog 
signals to digital data to be saved in a memory 150. The 
memory 150 is preferably a flash memory, but may include 
RAM (random- access memory) or ROM (read-only memory) to 

3 0 accomplish a temporary buffering or permanent storage of 
readout data. The memory 150 is in communication with the 
processor 12 5 for image processing and/or retrieval. A 
user interface 155 communicates with the processor 125 to 
provide a user with access to status information such as 
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"power on" and "ready." The user interface 155 can in- 
clude a visual display or audio output. 

[0020] The pixel array 120 is responsive to incident 
light to provide readout data and can be, for example, a 
5 CCD imager or a CMOS imager having a one or two- 
dimensional array of pixels. The processor 125 can be a 
general -purpose digital signal processor (DSP) or an ap- 
plication specific processor (ASIC) . If the pixel array 
120 is a CMOS imager, the processor 125 may be integrated 

10 with the pixel array 120 on a single substrate that in- 
cludes the necessary pixels 115 and timing and control 
element 130. In the embodiment illustrated in Figure 1, 
the filter array 110 is positioned immediately above the 
pixel array 12 0 to reduce stray light introduced between 

15 the two. The A/D converter 147 can be a sigma-delta or 
dual slope converter to convert the analog output of the 
pixel array 110 to a digital form for storage in the mem- 
ory 150. If the pixel array 110 is a CMOS imager, the A/D 
converter 14 5 could be integrated on a common chip with 

20 the array 110 and processor 125. Although the various 
components are illustrated with electrically conductive 
paths between them, other signal transport mechanisms, 
such as an optical bus, may also be used. 

[0021] First and second filters (100, 105) are preferably 
2 5 formed from FLC panes that become opaque to light upon 
the application of a positive voltage from both the ver- 
tical and horizontal filter drivers (135, 140) , and 
translucent upon the application of a negative voltage by 
each (135, 140). Alternatively, the filters (100, 105) 
30 can be constructed such that voltages of an opposite po- 
larity induce the opaque and translucent states. In ei- 
ther case, for FLC panes, the filter remains opaque or 
translucent after the voltage is removed, and does not 
change until an opposite polarity voltage is applied. In 
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Figure 1, the timing and control section 13 0 induces the 
vertical driver 135 to drive its second vertical output 
138 with a positive voltage and the first through fifth 
horizontal outputs (141-145) of the horizontal filter 
5 driver 140 to also drive a positive voltage to actuate 
all of the second filters 105 to their respective opaque 
states. If the first filters 100 are not already in their 
translucent states, the horizontal and vertical filter 
drivers (140, 135) are induced to drive the first filters 

10 100 with a negative voltage. Pixel portion B receives 
substantially reduced incident light, while portion A re- 
ceives substantially the entire incident light from the 
translucent first filters 100. The timing and control 
section 13 0 induces a first pixel readout when the second 

15 filters 105 are opaque and the first filters 100 translu- 
cent. A second pixel readout is induced when the states 
of the first and second filters (100, 105) are reversed, 
so that the processor 125 can distinguish between the 
spatial coordinates of an object corresponding to the two 

20 sets of filters. In effect, the number of pixels is dou- 
bled, with each filter corresponding to a separate pixel. 
[0022] In one embodiment, the first and second filters 
(10 0, 105) are not opaque when a positive voltage is ap- 
plied, but rather semi -opaque to filter light incident on 

25 portions A and B of the pixels 115. With the predeter- 
mined filter opacity known, luminance values would be ob- 
tained for the two spatial coordinates of the projected 
image while maintaining better light sensitivity than the 
embodiment described for the opaque filter states. Also, 

3 0 in a two dimensional implementation, the filter array 
would provide filter coverage for each A and B portion of 
each pixel in the array. Various techniques can be used 
to address and control the filters, such as addressing 
each individual filter in sequence, addressing all of the 
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A filters at one time and all of the B filters at another 
time, or grouping the filters by rows, columns or other 
geometries for addressing. 

[0023] In a CMOS imager implementation, the first and 
second filters (100, 105) can be positioned above the en- 
tire pixel 115,. or above the photosensitive portions of 
the pixel. Figure 2 illustrates first and second active- 
area filters (200, 205) positioned substantially over 
only the photosensitive portion 210 of a pixel manufac- 
tured in CMOS ("CMOS pixel 215"). The non-photosensitive 
portion 220 would contain control circuitry that does not 
respond significantly to incident light and would not re- 
quire filtering. For example, in a CMOS imager with a 14% 
fill-factor (14% of the total pixel area configured to be 
the photosensitive portion 210) , the first and second ac- 
tive-area filters (200, 205) would each cover at least 7% 
each of the total pixel area and be positioned directly 
above the photosensitive portion 210 of the CMOS pixel 
215. The first and second filters (200, 205) can also be 
implemented as an array micro-electromechanical elements, 
filters or shutters that are actuated to block or admit 
incident light onto the pixel portions A and B. 
[0024] Figures 3A - 3D each illustrate an embodiment that 
has a filter array 300 with four filters (305, 310, 315, 
320) over portions A, B, C, D, respectively, of each 
pixel 115. Analogous to the two-filter implementation 
shown in Figure 1, each of the four filters (305, 310, 
315, 32 0) are actuated sequentially to correspond with 
respective sequential readouts of the pixels 115. Figure 
3A shows the first filter 305 in a transparent state to 
communicate incident light 307 to portion A of each pixel 
115. The second, third and fourth filters are placed into 
an opaque state. The pixels 115 are read out, providing 
an indication of the amount of light 3 07 incident on por- 
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tion A. Figures 3B, 3C, or 3D illustrate the processor's 
125 actuation of the other filters in the four-filter 
sets, which can be programmed to occur in any desired se- 
quence. As with the two filter per pixel implementation, 
5 the filters can be addressed and actuated separately or 
in groups with an analogous vertical and horizontal 
driver set . 

[0025] Figure 4 illustrates a perspective view of an em- 
bodiment with an array of multiple-pixel filters 400, 

10 with each filter positioned in the incident light path 
402 for two adjacent pixels in an array of pixels 120. As 
illustrated, "odd" and "even" multiple-pixel filters 
(405, 410) are in the incident light paths for B and A 
portions, respectively, of the pixels 115. Thus, unlike 

15 the filters illustrated in Figures 3-5D, where each fil- 
ter is associated with only one pixel, the multiple-pixel 
filter array 400 illustrated in Figure 4 is configured 
for each filter to associate with equal halves of two 
pixels 115. Analogous to the two-filter implementation 

2 0 shown in Figure 1, each of the illustrated odd and even 
multiple-pixel filters (405, 410) are placed sequentially 
in their filtering and transparent states during respec- 
tive pixel readouts to provide an indication of the 
amount of light 402 incident on A and B portions. Embodi- 

2 5 ments of the invention can be expanded for a two- 
dimensional array, with a single filter covering a por- 
tion of multiple pixels to distinguish between the amount 
of incident light on each portion of each pixel. 
[0026] Figure 5 illustrates an exploded perspective view 

30 of an implementation of first and second filters (100, 
105) with the first filter 100 in its opaque state and 
the second 105 in its transparent state. Each filter 
(100, 105) includes respective thin FLC layers (500, 502) 
positioned between respective incoming (505, 507) and 



cross (510, 512) polarizers. Each of the cross polarizers 
(510, 512) are optically rotated by +90 degrees from the 
initial polarizers (505, 507) . In their original state, 
the FLC layers (500, 502) have their optical axis rotated 
+45 degrees from the optical axis of their respective 
initial polarizers (505, 507). 

[0027] In the first filter 100, the optical axis of the 
FLC layer 500 is rotated by -45 degrees upon application 
of a positive DC voltage to align the layer 500 with the 
optical axis of the initial polarizer 505. Non-polarized 
light 515 introduced to the initial polarizer 505 becomes 
vertically polarized and the FLC layer 500 does not 
change the orientation of the polarization axis of the 
transmitted light. Consequently, the first filter's 100 
crossed polarizer 510 blocks the polarized light 520 and 
the filter is considered to be in its opaque state. 
[0028] The second filter 105 is illustrated with the op- 
tical axis of its FLC layer 502 rotated by +45 degrees 
from its original +45 degree rotation upon application of 
a negative DC voltage, so that the layer 502 is aligned 
with the optical axis of its cross polarizer 512. Light 
polarized by the first polarizer 507 is rotated +90 de- 
grees by the FLC 502 to allow the light to pass through 
the second polarizer 510. 

[0029] Figure 6 illustrates an embodiment with the filter 
array positioned directly on the pixel array. The cross 
section illustrates the filter and pixel arrays (110, 
12 0) seated in a rigid package 600 that could be formed 
from rigid plastic, metal , or composite molding to hold 
the arrays (110, 12 0) and protect them from damage. 
[0030] Figure 7 illustrates an embodiment of the inven- 
tion in a document scanner. An object 700 is illuminated 
with a light source 705, and the object's image is di- 
rected to scanner carriage 707 that has a light director 
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725 that # in one implementation, is a lens to focus the 
image onto the pixel array 12 0 through the filter array 
110. Various light director schemes can be used to direct 
the image onto the pixel array, depending upon the physi- 
5 cal arrangement of the system components. In the illus- 
tration of Figure 7, three mirrors 710, 715 and 720 and a 
lens 725 are used in the scanner carriage 707. For CMOS 
and CCD imagers, the light source 705 can produce f lores- 
cent or incandescent ER in the visible spectrum (380 

10 through 780 nanometers) . The lens 725 is a converging 
lens to reduce the image onto the filter and pixel arrays 
(110, 120) . The lens 72 5 may include coatings to reduce 
the transmission of stray or reflected light to the pixel 
array 120. The carriage 707 is translated relative to the 

15 object 70 0 during multiple scans to capture an image of 
the entire object 700 in image post-processing. 
[0031] Instead of positioning a filter array on the 
imager, a filter array 73 0 may be positioned immediately 
adjacent the object 70 0 to be imaged. Each pixel mapped 

2 0 onto the object (the scanner platen) would be associated 
with at least two adjacent filters on the filter array 
730. The reflection of light 705 off the filter array 730 
would be removed in image post -processing to leave only 
the light reflected from the non-filtered mapped spaces 

25 on the object 700. For example, a sample image would be 
taken to capture the reflection of light off of all fil- 
ters in their opaque states. This sample image would then 
be subtracted from an object image in post -processing to 
complete a true image of the imaged object. Various fil- 

30 ter sequencings can be used, as described above. 

[0032] While various embodiments of the invention have 
been described, it will be apparent to those of ordinary 
skill in the art that many more embodiments and implemen- 
tations are possible. For example, while an imager system 
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has been described as including a light source to illumi- 
nate an object, the invention is also applicable to the 
imaging of object that emits its own radiation, as in in- 
frared imaging. 



